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Abstract —We consider joint detection of co-channel signals— 
specifically, signals which do not possess a natural separability 
dne to, for example, the mnitiple access technique or the use 
of multiple antennas. Iterative joint detection and decoding is 
a well known approach for utilizing the error correction code 
to improve detection performance. However, the joint maximum 
a posteriori probability (MAP) detector may be prohibitively 
complex, especially in a multipath channel. In this paper, we 
present an approximation to the joint MAP detector motivated 
by a factor graph model of the received signal. The proposed 
algorithm is designed to approximate the joint MAP detector 
as closely as possible within the compntational capability of the 
receiver. 

I. Introduction 

Detection of a desired signal in the presence of one or more 
interfering signals is a prevalent problem in dense wireless 
communication systems. As a result, designing receivers capa¬ 
ble of detection in the presence of interference has been a very 
active area of research with numerous algorithms proposed 
in literature. Iterative multiuser detection problems have been 
considered for code division multiple access (CDMA) 12, 11, 
spatial multiplexing 0-13], and multiuser MIMO 0, 0, 
among others. Receiver algorithms generally fit into one of 
three categories: linear filtering, interference cancellation, and 
joint detection. 

Linear filtering may be applied in the time, space, or space- 
time dimension(s) and includes techniques such as matched fil¬ 
tering, minimum mean square error (MMSE) equalization, and 
beamforming. In systems which employ spreading sequences 
or multiple antennas, linear filtering can be an effective means 
of interference mitigation, specifically when the spreading gain 
or number of antennas is greater than or equal to the number 
of signals present. 

Interference cancellation refers to algorithms in which each 
user’s signal is canceled from the received signal after detec¬ 
tion (e.g., 0, 0 and the references therein). Linear filtering 
combined with interference cancellation may further improve 
detection and has been a very successful approach for spatial 
multiplexing Eoj. Soft cancellation in conjunction with soft 
decoding of the channel code—often referred to as “turbo” 
interference cancellation—has been shown to achieve good 
results in a CDMA system 0. 

Optimal maximum a posteriori probability (MAP) detection 
is performed by jointly detecting both the desired and co¬ 
channel signals. The detection stage is separated from decod¬ 
ing and probabilistic information is passed between the joint 


MAP detector and a collection of single user decoders. The 
separation of detection and decoding is justified by message 
passing algorithms which operate on a factor graph of the 
joint probability density function ini. Yet, even with the 
separation of detection and decoding, joint MAP detection may 
be prohibitively complex as a result of high-order modulations, 
numerous users, or inter-symbol interference (ISI). 

A challenging case is detection in the presence of non- 
orthogonal, asynchronous interfering signals using a single 
receive antenna. That is, reception of co-channel signals which 
do not possess a natural separability due to a multiple access 
technique (such as CDMA) or multiple antennas. As a result, 
linear filtering and interference cancellation are ineffective 
especially when the signal power levels are similar. 

Joint MAP detection in such a signal model is developed 
and studied in na. The separability is achieved due to both 
frame and symbol timing offsets and an error correction code. 
Joint detection which accounts for the strongest ISI terms is 
proposed. Thus, the algorithm is exponentially complex in the 
number of co-channel signals. Eor this reason its application 
is limited to 2 users and BPSK modulation in llT^ . A large 
number of users or high-order modulations in addition to ISI 
due to the asynchronous signals makes the optimal joint MAP 
detector extremely complex. 

Jiang and Li consider single antenna interference cancella¬ 
tion in a frequency selective, multiple access channel llT3]l . The 
same channel code, interleaver, and modulation is assumed for 
all co-channel signals. Signal separability is obtained through 
the independence of each user’s multipath channel. Jiang and 
Li propose a concurrent MAP (CMAP) algorithm in which a 
Gaussian approximation is used for co-channel interference 
and MAP equalization for ISI. The CMAP algorithm is 
compared to joint MAP detectiorQ, the Rake Gaussian method 
proposed in ifTdll . and soft interference cancellation with MAP 
equalization. While the CMAP algorithm is the state-of-the-art 
in addressing the difficult detection problem described above, 
performance is degraded when the Gaussian approximation is 
made for strong co-channel interference terms. 

In this paper, we present a new approximation to the joint 
MAP detector which is motivated by a factor graph model of 
the received signal. The proposed algorithm is designed to ap¬ 
proximate the joint MAP detector as closely as possible within 

*Due to the complexity of the joint MAP detector, this method is only 
evaluated for two users with BPSK modulation in na 


the computational capability of the receiver. The complexity 
of the algorithm is adjustable and can be set to account for 
the capabilities of the receiver, the desired performance, or the 
difficulty of the detection task. 

The paper is organized as follows. The system model 
is presented in Section |II] followed by development of the 
MAP detector in Section Hn] The complexity of the proposed 
algorithm is compared with algorithms from the literature in 
Section and a detailed description of the proposed algo¬ 
rithm is provided in Section [V] The algorithms are compared 
via simulation in Section |VT] and conclusions are drawn in 
Section IVIII 

Notation: Let x denote a column vector x = 
[xo,... , We use the shorthand to denote the 

summation over the domain of Xk- Similarly, denotes the 
summation over the domain of the vector x and denotes 
the summation with respect to all variables except x^- 

II. System Model 

In this work we consider single antenna reception of U co¬ 
channel signals (users). Let the information bits, coded bits, 
and symbols of the Mth user be denoted by column vectors 
b("), and x*"\ respectively. We define the collection of 
these terms for all users as 

B = [b''\...,b^^>] 

C = [c''\...,c<^^] 

X = [x<'\...,x(^^]. 

The «th sample of the received signal is given by 

u =\ /=0 

where h*-"^ = ..., denotes the combined effect 

of the multipath channel and the transmit pulse for the Mth 
user, L is the number of channel taps, and are indepen¬ 

dent and identically distributed circularly-symmetric complex 
Gaussian random variables with variance cr^. The collection 
of all received samples is denoted r = [ro,... , In 

general the transmitted signals may be symbol-asynchronous. 
For the sake of notational simplicity, the model provided in ([TJ 
makes a number of assumptions about the received signal—for 
example, that the channel duration of the users L is identical 
and that the received signal is sampled at a single sample 
per symbol. However, the multiuser detection and equalization 
algorithms presented in this paper are applicable to the more 
general cases. 

III. MAP Detection 

The goal of the receiver is to detect all information bits B 
given observation r. Because of the complexity of sequence 
detection of B, we desire to perform MAP symbol-by-symbol 
(in our case, bit-by-bit) detection. The detector for the kth bit 
of user M is given by 

bf = argmax V p(B|r), (2) 


where the marginal is computed for According to Bayes’ 
rule, © is equivalent to 

= argmax ^/(r,B), (3) 

where the term 1 //(r) is a constant which has been removed. 
By the Total Probability Theorem, © can further be expressed 
as a marginalization over the full joint distribution as given by 

= argmax V /(r,X,C,B). (4) 

, (m) ^ , . 

The marginalization in (|4|i cannot be performed directly, but 
an iterative implementation of the sum-product algorithm is 
well suited for this task. 

A. Probability Distribution 

Taking into account conditional independence of the vari¬ 
ables, the joint distribution is given by 


N-\ 

/(r,X,C,B)=]^/(r„|x('\...,x(^) 

n =0 

U 

]~[ p(x<“>|c'“>)p(c(“>|b'“>)p(b'“^). (5) 

U~l 

Factorizations of the modulation p(x*^“^|c*'“^) and code 
p(c’^“^|b’'"^) constraints have been explored in the literature (see, 
for example, im, lEi). From © the likelihood function 
for each term r„ is dependent on a subset of the symbols. 
We define, x|“J = ..., xj,“']^ to denote the symbols 

from user u which have components in the r„ sample. The 
distribution is then given by 


N-l 

/(r,X,C,B)=f[/('-«I^W’---’47) 

H=0 

u 

]~[ /7(x(“)|c^“>)p(c'">|b'“>)p(b^“>). (6) 

M =1 

Soft output MAP equalization of an ISI channel may be 
accomplished via the BCJR algorithm Ea. This algorithm 
was extended to the case of joint detection of a desired 
and co-channel signal in ISI by Moon and Gunther na. 
The algorithm relies on the introduction of state variables 
mo,..., mAT into the likelihood function as follows: 

«=0 

N-l 

= n X /('■«’“«+! ■■■’ x^^\ m„)p(mo) (7) 

n =0 m „ 


where m„ = [x^**,.,,..., x^'^.,..., x’''^),.,..., x’'"'. ] L 

At a high level, local marginals for the symbols are com¬ 
puted by a forward and backward pass of the BCJR algorithm 




Fig. 1. Factor graph of /(r, X, C, B) for U = 2 and L = 4 based on the Fig. 2. Factor graph of /(r, X, C, B) for U = 2 and L = 4 based on the state 
factorization in space model factorization of 0 substituted into 0. 


(also known as the forward-backward algorithm). The forward 
messages are given by 

i 

a(m,+i) = ^ f(r„, m„+i ..., (8) 


yS(m,) = n X “"+ 1 - 4^^ in«)- (9) 

n~i ni„+i 

The messages may be defined recursively as given by 

a(m,+i) = ^ 7 (m,+i, m,)Q;(mi) (10) 

m, 

and 

/3(m,) = ^ 7 (m,+i, m,)yS(m,+i), (11) 

ni,+i 

where y(m,+i,m,) = /(r;,m,+i|x^'\ ... ,x^^,m,), a(mo) = 
p{mo) = 1, and /Simm) - 1. A marginal for a particular 
symbol is given by ^ a(in,)r(m,-, m,+i)y8(m,+i). 

The joint MAP detector is developed for the case of a received 
signal with two samples per symbol in lfT0 . 

B. Factor Graph Model 

The sum-product algorithm performs efficient marginaliza¬ 
tion by exploiting the factorization of the joint distribution 
/(r, X, C, B). As an example, consider the case of U — 2 and 
L - 4. The factor graph of the joint distribution in (|6]l is given 
in Fig. [1] Similarly, the factor graph of the joint distribution 
with the introduction of the state variables is shown in Fig. |2] 
In Fig. [T] fr,, denotes the factor /(r„|x|*J,xj^J) and, in Fig. |2] 


/r,, denotes the factor f(r„, m„+i \x^n \ ..., x!i^\ m„). We refer to 
the factor graphs in Fig. [T] and |2] as the fully connected graph 
and the state-space model (SSM) graph, respectively. 

The generalization of the BCJR algorithm to the factor 
graph of the joint distribution is given by the sum-product 
algorithm ifTSl . The factor nodes /7(x*"^|c*"^)p(c^"^|b^‘9)p(|j(«)) 
are further factored when implementing the sum-product algo¬ 
rithm. The factor nodes related to the observations /r„ and the 
symbol variable nodes make up the “detection block” of the 
factor graph. The fully connected graph contains cycles within 
the detection block; the SSM graph eliminates these cycles. 
Cycles have a negative impact on the convergence of the sum- 
product algorithm. In Section |V] we develop an algorithm to 
reduce the complexity of joint MAP detection based on the 
fully connected factor graph of Fig. [1] In Section [VT] we 
quantify the loss in performance when performing message 
passing on the fully connected graph versus the SSM graph. 

IV. Complexity 

For both graphs, the complexity associated with each of the 
detection factor nodes is where M is the modulation 

order of the symbols (assumed to be the same for each user). 
The complexity is exponential in the number of users and 
channel taps and therefore complexity prohibits use of the joint 
MAP detector in many potential co-channel signal scenarios. 
Specifically when either M » 2, U » 2, or L » 2 and 
especially when this is the case for two of these terms. As 
an example, the complexity for QPSK, 4 users, and 4 channel 
taps (i.e., M - 4, t/ = 4, and L = 4) is (9(10^). 









































Because of the problem of complexity with joint MAP de¬ 
tector, approaches with lower complexity have been considered 
for this problem. 

. Interference Cancellation: Cancellation may be per¬ 
formed based on either hard or soft decisions. Detection 
is performed starting with the strongest signal and contin¬ 
uing to the weakest. Soft cancellation may be combined 
with iterative processing to iteratively improve the soft 
estimates. 

. Rake Gaussian: This method was proposed in m for 
interleave-division multiple access. In this method, for the 
detection of symbol all other symbols are modeled 
as Gaussian random variables. This includes the symbols 
of all other users and all other symbols of the desired 
user, i.e., {x^^, ^}u'i^u,k'i=k- The mean and variance of the 
Gaussian distribution are computed from the extrinsic 
symbol probabilities obtained from demodulation and 
decoding. 

. Concurrent MAP (CMAP): This method was proposed 
in to improve upon the performance of the Rake 
Gaussian method. In this method, MAP equalization of 
each user’s signal is performed while all other user’s 
signals are modeled as Gaussian random variables. Thus, 
the complexity of the method is 0(U ■ M^), that is, linear 
in the number of users and exponential in the number of 
channel taps. 

Visual comparisons of the Rake Gaussian and CMAP al¬ 
gorithms are given using factor graphs. The factor node fr, 
from the example in Fig. [1] is used to represent the approx¬ 
imations made by the Rake Gaussian and CMAP algorithms 
when computing the message in Figs. |3] and |4] 

respectively. The single arrow represent messages containing 
discrete distributions and the double arrow represent messages 
which contain a mean and variance based on a Gaussian 
approximation. 

The graphical models of Figs. |3] and |4] motivate a new ap¬ 
proach in which the distribution of weaker terms in the signal 
component of r„ are modeled as Gaussian random variables. 
Sum-product message passing is performed for the stronger 
terms in r„. This hybrid approach has a complexity determined 
by the number of messages with discrete distributions and 
maintains a single, connected graph. The graphical model for 

the hybrid approach is shown in Fig.|5]where symbols x^}\ x^}\ 

il) (2) ^ ^ 

Xj , and Xj are the strongest component in rj, for users 1 and 

2 (i.e., the power of the channel coefficient is strongest 

for these terms). This model is motivated by common transmit 

pulse shapes which contain the majority of their energy within 

the center of the pulse and multipath channels which often 

exhibit an exponential decay. A detailed description of the 

algorithm is provided in the following section. 

V. Approximate MAP Detection Algorithm 

Consider a generic interference model (to represent inter¬ 
symbol interference, co-channel interference, or both) in which 
K signal components xi, X 2 ,..., xa: are received with channel 



Fig. 4. Factor graph motivated representation of the CMAP method. As 
shown, this factor is a slice of the overall graph to implement MAP 
equalization of user 1 while modeling the interference from user 2. 



Fig. 5. Factor graph motivated representation of the approximate MAP 
method developed in this work. 

























coefficients h\,h2,... ,hK, respectively. The received signal is 
given by 

K 

J ^ hkXk + w 
k=l 

where y represents one sample of a larger sequence of received 
samples and the noise w is modeled as a circularly symmetric 
complex Gaussian random variable with variance cr^. The 
factor associated with the received sample y is given by 

f(y\xi,...,XK) hkXk, <jA 

' k=l ' 

where the channel coefficients and the noise power cr^ are 
assumed to be known. 

The message from factor node fy to variable node Xk is 
denoted Similarly, the message from variable node Xk 

to factor node /,, is denoted According to the sum- 

product algorithm, the message m is given by 

nify-^xiixi) = ^ f{y\x \,..., v/f) j~[ n^^^f^(xk). (12) 

ki^i 

The proposed algorithm modihes the sum-product algorithm 
computations as follows: 

. The mean and variance of the input messages are com¬ 
puted according to 

Xk 

" Yj \xk - f^xfn^.^f^ixk) 

Xk 

for all k = 1,. ..,K. 

. For computation of the outgoing message nif^^^^ixi), the 
remaining variables for k / are sorted by their channel 
coefficient power \hk'^. Let the set ^ index the variables 
associated with the strongest channel coefficients. These 
variables remain a part of the local marginalization as 
given in (Ell. The number of variables in the set will 
depend on the acceptable complexity in implementation. 
The indices of the weaker components are included in 
the set S and the distributions of these variables are 
approximated by Gaussian random variables to eliminate 
the marginalization over these variables. Let the variables 
associated with sets and S be given by and x^, 
respectively. 

. The message is computed with the following approximate 
sum-product computation: 

^^f(y\xi,Xyi)Y\n^^^f^(xk) 

Xja keJi 

where 

f(y\xi,xji) = 

CNW, hiXi + ^ hkXk + h,n„, ,cr^ + Y j. (13) 

' ke^ Ie3 Ie3 ' 



Fig. 6. FER comparison of the joint MAP state-space model (Joint MAP 
(SSM)), the joint MAP fully connected factor graph (Joint MAP (FG)), the 
proposed approximate MAP algorithm (Approx MAP), CMAP (Concurrent 
MAP), and soft interference cancellation (Soft IC) algorithms with SIR=0 dB. 

This algorithm is applied to the computation of the sum- 
product messages at each of the detection factors in Fig. [1] 
The complexity of the proposed algorithm for each factor is 
0{UL- where \yH\ is the number of symbols included 

in the set Jl. Thus, by choosing the size of the complexity 
of the algorithm may be adjusted to match the computational 
capability of the receiver and performance requirements. 

VI. Numerical Results 

We hrst simulate the performance for a scenario in line 
with the one considered in El: two users (U - 2) each 
employing BPSK modulation (M = 2). ISI results from symbol 
timing offsets between the users and a transmit pulse with a 
duration of four symbol periods (L = 4). The selection of 
these parameters allows us to simulate the joint MAP detector 
for the purpose of comparison. The simulation parameters are 
summarized as follows: 

. Code: 1/2-rate turbo code with 500 coded bits 

. Modulation: BPSK 

. Pulse: Square root raised cosine with L = 4 and roll-off 
factor 0.35 

. A relative time delay between the users of 7/4 is chosen 
where T is the symbol period 

. A relative phase offset between the channel coefficients 
of the users of 7r/6 is chosen 

. 15 iterations of message passing are performed 
The FER performance is shown in Fig. |6] for the joint 
MAP (with the SSM and fully connected factor graphs), 
the proposed novel approach, CMAP, and soft interference 
cancellation algorithms. The approximate MAP algorithm is 
implemented with |J?1| = 3. Thus, the proposed approximate 
MAP algorithm and the CMAP algorithm have the same order 
of complexity (per iteration). The performance of the fully 
connected factor graph demonstrates a loss of about 0.5 dB 
compared to the SSM factor graph. The proposed approximate 
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Fig. 7. FER of the proposed and CMAP algorithms with respect to SIR. 
Both signals ai‘e detected, and the FER of the desired signal is shown. Ten 
iterations of the receiver are performed. 

MAP algorithm is based on the fully connected graph and 
we observe that it achieves nearly identical performance to 
the receiver which uses exact sum-product computations. At 
a FER of 10“^ the proposed approximate MAP approach 
and Concurrent MAP approach demonstrate losses of 0.5 dB 
and 1.5 dB, respectively, compared to joint MAP detection 
based on the SSM. We observe that the Soft IC method 
becomes limited by interference as signal-to-noise ratio (SNR) 
increases. 

We also consider a 2-user scenario with QPSK modulation 
with a 4-tap multipath channel. The average power in each 
multipath component is given by [0.644,0.237,0.087,0.032]. 
In Fig. |2] the FER of the proposed approximate MAP algo¬ 
rithm and the CMAP algorithm is shown. Both SNR and 
signal-to-interference ratio (SIR) are computed with respect 
to the instantaneous power in the multipath channel. The 
most significant improvement in FER is achieved by the 
proposed approximate MAP algorithm when the signals have 
similar power levels (-3 < SIR < 3 dB) and the SNR 
is high. In Fig. [S] the FER is shown with respect to the 
number of iterations where we observe that the proposed 
algorithm converges 1-2 iterations faster than CMAP. Thus, 
for \^\-L-\, the proposed algorithm reduces computational 
complexity by 20-40% due to faster convergence. 

VII. Conclusion 

In this paper, an algorithm is developed which approximates 
joint MAP detection and equalization in co-channel interfer¬ 
ence. The approximate MAP algorithm is based on a fully 
connected factor graph of the joint probability distribution. 
The algorithm was shown to operate within 0.5 dB of the 
joint MAP state-space model receiver where the degradation in 
performance was due to the associated factor graph model. Ad¬ 
ditionally, the proposed algorithm both improves performance 
and reduces complexity when compared to the state-of-the-art. 
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Fig. 8. FER of the proposed and CMAP algorithms with respect to the number 
of iterations performed. The SIR is -4 dB. 
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